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Abstract. One of the main applications of semidefinite programming lies in linear systems 
and control theory. Many problems in this subject, certainly the textbook classics, have matri- 
ces as variables, and the formulas naturally contain non-commutative polynomials in matrices. 
These polynomials depend only on the system layout and do not change with the size of the 
matrices involved, hence such problems are called "dimension- free" . Analyzing dimension-free 
problems has led to the development recently of a non-commutative (nc) real algebraic ge- 
ometry (RAG) which, when combined with convexity, produces dimension-free Semidefinite 
Programming. This article surveys what is known about convexity in the non-commutative 
setting and nc SDP and includes a brief survey of nc RAG. Typically, the qualitative prop- 
erties of the non-commutative case are much cleaner than those of their scalar counterparts - 
variables in R". Indeed we describe how relaxation of scalar variables by matrix variables in 
several natural situations results in a beautiful structure. 



1. Introduction 

Given symmetric (. x I symmetric matrices with real entries Aj^ the expression 

9 

(1.1) L{x) = h + ^AjXj^Q 

i=i 

is a linear matrix inequality (LMl). Here >- means positive definite, x = (xi, . . . ,Xg) S 
and of interest is the set of solutions x. Taking advantage of the Kronecker (tensor) product 
A (S> B oi matrices, it is natural to consider, for tuples of symmetric n x n matrices X = 
(Xi, . . . , Xg) G (SM"^")^', the inequality 

9 

(1.2) L{X)=h®In + ^Aj®Xj)-Q. 

i=i 

For reasons which will become apparent soon, we call expression (1.2) a non-commutative 
LMI (nc LMI). Letting T>L{n) denote the solutions X of size n x n, note that 2^l(1) is the 
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solution set of equation (1.1). In many areas of mathematics and its applications, the inequality 
(1.2) is called the quantized version of inequality (1.1). 

Quantizing a polynomial inequality requires the notion of a non-commutative (free) poly- 
nomial which can loosely be thought of as a polynomial in matrix unknowns. Section 1.2 below 
gives the details on these polynomials. For now we limit the discussion to the example, 



The set {{x,y) G . p(^x,y) > 0} is a semi-algebraic set. By analogy, the set {{X,Y) : 
p{X,Y) >- 0} is a non-commutative semi-algebraic set. 

nc LMIs, and more generally non-commutative semi-algebraic sets, arise naturally in semi- 
definite programming (SDP) and in linear systems theory problems determined by a signal-flow 
diagram. They are of course basic objects in the study of operator spaces and thus are related 
to problems like Connes' embedding conjecture [Con76, KS08a] and the Bessis-Moussa-Villani 
(BMV) conjecture [BMV75] from quantum statistical mechanics [KS08b]. As is seen in Theo- 
rem 2.4 below, they even have something to say about their scalar (commutative) counterparts. 
For some these non-commutative considerations have their own intrinsic interest as a free ana- 
log to classical semi-algebraic geometry. 

Non-commutative will often be shortened to nc. 

1.1. The roadmap. The paper treats four areas of research concerning nc LMIs and nc 
polynomials. 

In the remainder of the introduction we first, in Subsection 1.2, give additional background 
on a core object of our study, polynomials in non-commuting variables. The initiated reader 
may wish to skip this subsection. Subsections 1.3, 1.4, 1.5, and 1.6 give overviews of the four 
main topics of the survey. 

The body of the paper consists of six sections. The first four give further detail on the 
main topics. Except for Section 3 which has its own motivation subsection, motivation for our 
investigations is weaved into the discussion. Convexity is a recurring theme. Section 6 offers a 
list of computer algebra packages for work in a free *-algebra revolving around convexity and 
positivity. 

1.2. Non-commutative polynomials. Let denote the real algebra of polynomials in 
the non-commuting indeterminates x = (xi, . . . , Xg). Elements of M{x) are non- commutative 
polynomials, abbreviated to nc polynomials or often just polynomials. Thus, a non- 
commutative polynomial p is a finite sum. 



(1.3) 



p{x, y) = 4 — X — y — (2x^ + xy + yx + 2y^). 



Of course, for symmetric n x n matrices X, Y 



(1.4) 



p{X, Y) = Un- X - Y - {2X^ + XY + YX + 2Y'^). 



(1.5) 
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where each w is a word in (xi, . . . , Xg) and the coefficients pw G The polynomial p of equation 
(1.3) is a non- commutative polynomial of degree two in two variables. The polynomial 

(1.6) q = xix\ + x\xi -\- x^xiX2 + X2Xix^ 

is an non- commutative polynomial of degree four in three variables. 

1.2.1. Involution. There is a natural involution * on M(2;) given by 

(1.7) p* = Y^P^w*^ 
where, for a word w, 

(1.8) w = Xj^Xj2 ■ ■ ■ Xj„ I— )• = Xj^ ■ ■ ■ Xj^Xj^. 

A polynomial p is symmetric if p* = p. For example, the polynomials of equation (1.3) is 
symmetric, whereas the q of equation (1.6) is not. In particular, x* = Xj and for this reason 
the variables are sometimes referred to as symmetric non-commuting variables. 

Denote, by M(rE)^, the polynomials in M.{x) of (total) degree d or less. 

1.2.2. Substituting Matrices for Indeterminates. Let (§R"^")3 denote the set of (^-tuples X = 
{Xi, . . . , Xg) of real symmetric n x n matrices. A polynomial p{x) = p{xi, . . . , Xg) G M(x) can 
naturally be evaluated at a tuple X € (SM"^")^ resulting in an n x n matrix. Equations (1.3) 
and (1.4) are illustrative. In particular, the constant term p0 of p{x) becomes p^In] i-e., the 
empty word evaluates to /„. Often we write p(0) for p^ interpreting the as € M^. As a 
further example, for the polynomial q from equation (1.6), 

q{X) = XiX'i + XlXi + XsXiX2 + X2X1X3. 

The involution on M{x) that was introduced earlier is compatible with evaluation at X 
and matrix transposition, i.e., 

p*{x)=p{xr, 

where p{X)* denotes the transpose of the matrix p{X). Note, if p is symmetric, then so is 
p{X). 

1.2.3. Matrix-Valued Polynomials. Let ]B.{x)^^^' denote the 5x6' matrices with entries from 
R{x). In particular, if p G M(x)^^'^', then 

(1.9) P = J2p^'^' 

where the sum is finite and each p^ is a real 5x6' matrix. Denote, by M(x)^^'' , the subset of 
]^^^^(5x(5' -^j^ose polynomial entries have degree d or less. 

Evaluation at X € (SM""^"")^ naturally extends to p G M(a;)^^^' via the Kronecker tensor 
product, with the result, p{X), a 6 x 6' block matrix with n x n entries. The involution * 
naturally extends to M.{x)^^^ by 



:i.io) P = }^P> 
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for p given by equation (1.9). A polynomial p G ]R(x) is symmetric if p* = p and in this 
case p{X) =p{X)*. 

A simple method of constructing new matrix valued polynomials from old ones is by direct 
sum. For instance, if pj € 'K{x)^J^^^ for j = 1, 2, then 

1.2.4. Linear Matrix Inequalities (LMIs). Given symmetric i x i matrices Aq,Ai, . . . ,Ag, the 
expression 

9 

(1.11) Lix) = Ao + ^AjXj 

i=i 

is an affine linear nc matrix polynomial, better known as a linear (or affine linear) pencil. In 
the case that j4o = 0, L is a truly linear pencil; and when Aq = I, we say L is a monic 
linear pencil. 

The inequality L{x) for x G IKS' is a linear matrix inequality (LMI). LMIs are ubiq- 
uitous in science and engineering. Evaluation of L at X G (SM"^")^ is most easily described 
using tensor products as in equation (1.2) and the expression L{X) ;^ is a non-commutative 
LMI, or nc LMI for short. 

1.3. LMI Domination and Complete Positivity. This section discusses the nc LMI ver- 
sions of two natural LMI domination questions. To fix notation, let 

9 

L{x) = ^0 + ^ ^jXj, 
i=i 

be a given linear pencil (thus Aj are symmetric (. x i matrices). For a fixed n the solution 
set of all X G (SM"^")^ satisfying L{X) ^ is denoted Viin) and the sequence (graded set) 
(X'j;,(n))„gN is written Vl. Note that I^l(1) is the solution set of the classical (commutative) 
LMI, L{x) y 0. 

Given linear matrix inequalities (LMIs) Li and L2 it is natural to ask: 

(Qi) when does one dominate the other, that is, when is Plj(1) C Vi^{l)l 
(Q2) when are they mutually dominant, that is, Dl^(1) = Vl^{2)1 

While such problems can be NP-hard, their nc relaxations have elegant answers. Indeed, they 
reduce to constructible semidefinite programs. We chose to begin with this topic because it 
offers the most gentle introduction to our matrix subject. 

To describe a sample result, assume there is an x G MP such that both Li{x) and L2{x) 
are both positive definite, and suppose Pij(l) is bounded. If 'Di^{n) C Vi^{n) for every n, 
then there exist matrices Vj such that 

(Ai) L2(x) = V^Li{x)Vi + • • • + V;Li{x)V^. 



Pi ®P2 



Pi 
P2 
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The converse is of course immediate. As for (Q2) we show that Li and L2 are mutually 
dominant (Pij(n) = T>L^{n) for all n) if and only if, up to certain redundancies described in 
detail in Section 2, Li and L2 are unitarily equivalent. 

It turns out that our matrix variable LMI domination problem is equivalent to the clas- 
sical problem of determining if a linear map r from one subspace of matrices to another is 
"completely positive" . Complete positivity is one of the main techniques of modern operator 
theory and the theory of operator algebras. On one hand it provides tools for studying LMIs 
and on the other hand, since completely positive maps are not so far from representations and 
generally are more tractable than their merely positive counterparts, the theory of completely 
positive maps provides perspective on the difficulties in solving LMI domination problems, no 
LMI domination is the topic of Section 2. 

1.4. Non-commutative Convex Sets and LMI Representations. Section 1.3 dealt with 
the (matricial) solution set of a Linear Matrix Inequality 

Vl = {X: L{X)yO}. 

The set Vl is convex in the sense that each T)i[n) is convex. It is also a non-commutative 
basic open semi-algebraic set (in a sense we soon define). The main theorem of this section is 
the converse, a result which has implications for both semidefinite programming and systems 
engineering. 

Let p G 'K{xY'^^ be a given symmetric non-commutative 5 x (5-valued matrix polynomial. 
Assuming that p(0) >- 0, the positivity set T>p{n) of a non-commutative symmetric polynomial 
p in dimension n is the component of of the set 

{X G (SIR"^")^': p{X) >- 0}. 

The positivity set. Dp, is the sequence of sets (Pp(n)), which is the type of set we call a 
non-commutative basic open semi-algebraic set. The non-commutative set Vp is called 
convex if, for each n, T)p{n) is convex. A set is said to have a Linear Matrix Inequality 
Representation if it is the set of all solutions to some LMI, that is, it has the form Dl for 
some L{x) = I + AjXj. 

The main theorem of Section 3 says: if p(0) >- and T>p is bounded, then Pp has an LMI 
representation if and only if Dp is convex. 

1.5. Non-commutative Convex Polynomials have Degree Two. We turn now from 
non- commutative convex sets to non-commutative convex polynomials. The previous section 
exposed the rigid the structure of sets which are both convex and the sublevel set of a non- 
commutative polynomial. Of course if p is concave {—p is convex), then its sublevel sets are 
convex. But more is true. 

A symmetric polynomial p is matrix convex, if for each positive integer n, each pair of 
tuples of symmetric matrices X G (SM">^")5 and Y G (SM"^")9, and each < t < 1, 

p{tX + (1 - t)Y) < tp{X) + (1 - t)p{Y). 
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The main result on convex polynomials, given in Section 4, is that every symmetric non- 
commutative polynomial which is matrix convex has degree two or less. 

1.6. Algebraic certificates of non-commutative positivity: Positivstellensatze. An 

algebraic certificate for positivity of a polynomial p on a semi-algebraic set S is a Positivstel- 
lensatz. The familiar fact that a polynomial p in one-variable which is positive on S = M is a 
sum of squares is an example. 

The theory of Positivstellensatze - a pillar of the field of semi-algebraic geometry - underlies 
the main approach currently used for global optimization of polynomials. See [ParOO, LasOl] for 
a beautiful treatment of this, and other, applications of commutative semi-algebraic geometry. 
Further, because convexity of a polynomial p on a set S is equivalent to positivity of the 
Hessian of p on 5, this theory also provides a link between convexity and semi-algebraic 
geometry. Indeed, this link in the non-commutative setting ultimately leads to the conclusion 
the a matrix convex non-commutative polynomial has degree at most two. 

Polynomial optimization problems involving non-commuting variables also arise naturally 
in many areas of quantum physics, see [PNAlO, NPA]. 

Positivstellensatze in various incarnations appear throughout this survey as they arise 
naturally in connection with the previous topics. Section 5 contains a brief list of algebraic 
certificates for positivity like conditions for non-commutative polynomials in both symmetric 
and non-symmetric nc variables. Thus, this section provides an overview of non-commutative 
semi-algebraic geometry with the theme being that nc Positivstellensatze are cleaner and more 
rigid than there commutative counterparts. 



In this section we expand upon the discussion of nc LMI domination of Subsection 1.3. 
Recall, a monic linear pencil is an expression of the form 

9 



where, for some I, the Aj are symmetric £ x £ matrices with real entries and / is the H. x i 
identity. For a given positive integer n. 



and let Vi denote the sequence of sets (2?i(n))nGN- Thus Vl is the solution set of the nc LMI 
L{X) >- and is the solution set of the traditional LMI L{x) y {x e ). We caU Vl 

an nc LMI. 



2. LMI Domination and Complete Positivity 




VL{n) = {X e (SM"^")3 : L(A) 0} 



2.1. Certificates for LMI Domination. This subsection contains precise algebraic charac- 
terizations of nc LMI domination. Algorithms, the connection to complete positivity, examples, 
and the application to a new commutative Positivstellensatz follow in succeeding subsections. 



SDP IN MATRIX UNKNOWNS 



7 



Theorem 2.1 (Linear Positivstellensatz [HKM]). Let Lj G SR'^J^'^J (x), j = 1,2, be monic 
linear pencils and assume Plj(1) is bounded. Then T>l^ C T>l^ if and only if there is a fi 
and an isometry V G ]RA"^i><'^2 g^^^/j ff^f 

(2.1) L2{x) = V*{l^0Li{x))V = Y,y!Li{x)Vj. 
Suppose L G SM'^^'^(x), 

i=i 

is a monic linear pencil. A subspace "^^ C R'^ is reducing for L lil-L reduces each Aj\ i.e., if 
AjTi C "H. Since each Aj is symmetric, it also follows that Ajl-i^ C "H^. Hence, with respect 
to the decomposition M'^ = © L can be written as the direct sum, 

L = L®L^ = 

and Aj is the restriction of Aj to "H. (The pencil L-^ is defined similarly.) If T-L has dimension 
I, then by identifying H. with M^, the pencil L is a monic linear pencil of size I. We say that L 
is a subpencil of L. If moreover, = D^, then L is a defining subpencil and if no proper 
subpencil of L is a defining subpencil for D^, then L is a minimal defining (sub)pencil. 

Theorem 2.2 (Linear Gleichstellensatz [HKM]). Suppose Li,L2 are monic linear pencils with 
^Li(l) hounded. Then T>l^ = T>l^ if and only if minimal defining pencils Li and L2 for T>l^ 
and 1^12 respectively, are unitarily equivalent. That is, there is a unitary matrix U such that 

(2.2) L2{x) = U*Li{x)U. 

2.2. Algorithms for LMIs. Of widespread interest is determining if 

(2.3) VL,a)<ZVL,{l), 

or if 2?2.i(l) = ^L2(l)- example, the paper of Ben-Tal and Nemirovski [BTN02] exhibits 
simple cases where determining this is NP-hard. While we do not give details here we guide 
the reader to [HKM, Section 4] where we prove that T>l^ C T>l^ is equivalent to the feasibility 
of a certain semidefinite program which we construct explicitly in [HKM, Section 4.1]. Of 
course, if T>l^ C D^^, then Vi-^ll) C T>l^{1). Thus our algorithm is a type of relaxation of the 
problem (2.3). 

Also in [HKM] is an algorithm (Section 4.2) easily adapted from the first to determine if 
Vl is bounded, and what its "radius" is. By [HKM, Proposition 2.4], Vl is bounded if and 
only if T>l{1) is bounded. Our algorithm thus yields an upper bound of the radius of Pl(1). In 
[HKM, Section 4.3] we solve a matricial relaxation of the classical matrix cube problem, finding 
the biggest matrix cube contained in D^. Finally, given a matricial LMI set Vl, [HKM, Section 
4.4] gives an algorithm to compute the linear pencil L G SM'^^^(a;) with smallest possible d 
satisfying T>l = V^. 



L 




where 



L 



I + Y^A, 
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2.3. Complete Positivity and LMI Inclusion. To monic linear pencils Li and L2, 

9 

(2.4) Lj{x) = I + Y1 ^J-.^^^ ^ SR'^^'"^^ {x), j = l,2 

are the naturally associated subspaces of dj x dj (j = 1,2) matrices 

(2.5) Sj = span{/, Aj^i : ^ = 1, . . . , 5} = span{Lj {X): X £R^} C SM'^^ >^'^j . 

We shall soon see that the condition L2 dominates Li, equivalently Vl-^ C "Dl^, is equiv- 
alent to a property called complete positivity, defined below, of the unital linear mapping 
T : Si ^ S2 determined by 

(2.6) T{Ai^i) = A2,i. 

A recurring theme in the non-commutative setting, such as that of a subspace of C*-algebra 
[Arv69, Arv72, Arv08] or in free probability [Voi04, Voi05] to give two of many examples, is the 
need to consider the complete matrix structure afforded by tensoring with n x n matrices 
(over positive integers n). The resulting theory of operator algebras, systems, spaces and 
matrix convex sets has matured to the point that there are now several excellent books on the 
subject including [BLM04, Pau02, Pis03]. 

Let Tj Q M'^J^'^J be unital linear subspaces closed under the transpose, and (/> : 7i ^ Ti a 
unital linear *-map. For n G N, induces the map 

called an ampliation of (p. Equivalently, 





"Til • 


Tin 


\ 




'HTii) ■ 


• • (p{Tln 


v 


Tnl ■ 


■ T 

nn_ 


) 




>(r„i) • 


■ ■ (t>{Tnn 



for Tij £ Ti- We say that (f> is fc-positive if (p). is a positive map. If (p is A:-positive for every 
/c € N, then cp is completely positive. 

2.4. The Map r is Completely Positive. A basic observation is that ra-positivity of r is 
equivalent to the inclusion VL^{n) C VL^{n). Hence C Vl^ is equivalent to complete pos- 
itivity of r, an observation which ultimately leads to the algebraic characterization of Theorem 
2.1. 

Theorem 2.3. Consider the monic linear peneils of equation (2.4) and assume thafDi-^^V) is 
hounded. Let t : Si ^ S2 he the unital linear map of equation (2.6). 

(1) r is n-positive if and only if'DL-^{n) C T>L^[n); 

(2) r is completely positive if and only ifT>i^ C V^.^. 

Conversely, suppose D is a unital *-subspace of SM'^^'^ and t -.T) ^ SM'^ ^'^ is completely 
positive. Given a basis {/, ^1, . . . ,Ag} for P, let Bj = T{Aj). Let 

Li(x) = I + ^ A.jXj, L2{x) = I + ^ BjXj. 
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The complete positivity of r implies, if Li{X) >- 0, then L2{X) >- and hence C Vl^- 
Hence the completely positive map r (together with a choice of basis) gives rise to an LMI 
domination. 



2.5. An Example. The following example illustrates the constructs of the previous two sub- 
sections. Let 





"o 


1 


o" 




"o 





l" 




' 1 


Xl 


X2 


Li(xi,X2) = / + 


1 








Xi + 











X2 = 


Xi 


1 


















1 










X2 





1 



p3x3, 



'x) 



and 



Then 



L2(xi,X2) 



1 


Xl + 


1 




-1 


1 


2/2 = 



1 + Xl X2 
X2 1 - Xl 



G SI 



1,2x2 



X). 



Vl, = {(Xl, X2) :I-Xf- Xi >- 0}, 
Pl,(1) = {(Xl, X2) G M": Xf + xl < 1}, 
Vl,{1) = {{XuX2) G M": Xf+Xl < 1}. 
Thus 2?ij(l) = Vl^{1). On one hand, 

Tn 31 \ 

so Li(Xi,X2) >- does not imply L2{Xi,X2) >- 0. 

On the other hand, L2{Xi, X2) >- does imply Li{Xi, X2) >- 0. The map r : ^2 
our example is given by 



( 


"i 0" 







3' 

4 









3 
_4 






1 

1 



1-^ 



1 
1 
1 
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1 




1 

1 



1-^ 



1 



1 



Consider the extension of r to a unital linear *-map i{j : 



p2x2 



Sx3 



, defined by 



1 1 
1 1 
1 



E12 ^ - 



1 

1 

1 -1 



E21 ^ - 



1 

0-1 

1 1 



E22 ^ - 



1 







Si in 



-1 
1 
1 



(Here Eij are the 2x2 matrix units.) To show that ip is completely positive compute its Choi 
matrix defined as 



(2.7) 



C 



^{Eii) V(^12) 
i;{E2l) V(^22) 



[Pau02, Theorem 3.14] says ip is completely positive if and only if C ^ 0. The Choi matrix is 
the key to computational algorithms in [HKM, Section 4]. In the present case, to see that C 
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is positive semidefinite, note 



C = -W*W for W 
2 



Now ip has a very nice representation: 



1 1 1 
11-10 



(2i 



1 


'Vi 




's o" 






2 


V2 




s 




V2 



1 1 
1 



and Vo 



1 

1 -1 



, thus W 



.) In 



for all S" G M2x2^ (jj^^^ ^ 
particular, 

(2.9) 2Li(x,y) = V{L2{x,y)Vi + ViL2{x,y)V2. 

Hence L2{Xi,X2) >- implies Li{Xi,X2) >~ 0, i.e., Vl^ C Vl^. 

The computations leading up to equation (2.9) illustrate the proof of our linear Positivstel- 
lensatz. Theorem 2.1. For the details see [HKM, Section 3.1]. 



2.6. Positivstellensatz on a Spectrahedron. Our non-commutative techniques lead to a 
cleaner and more powerful commutative Putinar-type Positivstellensatz [Put93] for p strictly 
positive on a bounded spectrahedron T>l{1) = {x G : L{x) y 0}. In the theorem which 
follows, SM'^^'^[y] is the set of symmetric d x d matrices with entries from M[y], the algebra of 
(commutative) polynomials with coefficients from R. Note that an element of SM'^^'^[y] may 
be identified with a polynomial (in commuting variables) with coefficients from SM'^^"'. 

Theorem 2.4. Suppose L G SM°'^'^[y] is a monic linear pencil and ^^l(1) is bounded. Then 
for every symmetric matrix polynomial p G with pI^^^j^^ >- 0, there are Aj G M^^^[y], 

and Bk G satisfying 

(2.10) p = ^A*A,+ 

j k 

The Positivstellensatz, Theorem 2.4, has a non-commutative version for 5x5 matrix 
valued symmetric polynomials p in non-commuting variables positive on a nc LMI set T>i, see 
[HKM]. In the case this matrix valued polynomial p is linear, this Positivstellensatz reduces to 
Theorem 2.1, which can thus be regarded as a "Linear Positivstellensatz". For perspective we 
mention that the proofs of our Positivstellensatze actually rely on the linear Positivstellensatz. 
For experts we point out that the key reason LMI sets behave better is that the quadratic 
module associated to a monic linear pencil L with hounded Vl is archimedean. 

We shall return to the topic of Positivstellensatze in Section 5. 
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3. Non-commutative Convex semi-algebraic Sets are LMI Representable 

The main result of this section is that a bounded convex non-commutative basic open 
semi-algebraic set has a monic Linear Matrix Inequality representation. Applications and con- 
nections to semidefinite programming and linear systems engineering are discussed in Section 
3.4. The work is also of interest in understanding a non-commutative (free) analog of convex 
semi-algebraic sets [BCR98]. 

For perspective, in the commutative case of a basic open semi-algebraic subset C of M^, 
there is a stringent condition, called the "/ine tesi" , which, in addition to convexity, is necessary 
for C to have an LMI representation. In two dimensions the line test is necessary and sufficient, 
[HV07], a result used by Lewis-Parrilo-Ramana [LPR05] to settle a 1958 conjecture of Peter 
Lax on hyperbolic polynomials. Indeed LMI representations are closely tied to properties of 
hyperbolic polynomials; see this volume, the survey of Helton and Nie. 

In summary, if a (commutative) bounded basic open semi-algebraic convex set has an LMI 
representation, then it must pass the highly restrictive line test; whereas a non-commutative 
bounded basic open semi-algebraic set has an LMI representation if and only if it is convex. 

A subset S of (SM"^")^ is closed under unitary conjugation if for every X = (Xi, . . . , Xg) G 
S and U is a n X n unitary, we have U*XU = {U*XiU, . . . , U*XgU) S S. The sequence C = 
(C(n))„gp^, where C{n) C (SM"-^")^, is a non-commutative set if it is closed under unitary 
conjugation and direct sums; i.e., if X = {Xi, . . . , Xg) G C(n) and Y = {Yi, . . . , Yg) G C{m), 
then X ®Y = {Xi <BYi, . . . , Xg ®Yg) G C(n + m). Such set C has an LMI representation if 
there is a monic linear pencil L such that 

C = Vl. 

Of course, if C = T>l, then the closure C of C has the representation {X : L{X) ^ 0} and so we 
could also refer to C as having an LMI representation. 

Clearly, if C has an LMI representation, then C is a convex non-commutative basic open 
semi-algebraic set. The main result of this section is the converse, under the additional as- 
sumption that C is bounded. 

Since we are dealing with matrix convex sets, it is not surprising that the starting point 
for our analysis is the matricial version of the Hahn-Banach Separation Theorem of Effros and 
Winkler [EW97] which says that given a point x not inside a matrix convex set there is a 
(finite) LMI which separates x from the set. For a general matrix convex set C, the conclusion 
is then that there is a collection, likely infinite, of finite LMIs which cut out C. 

In the case C is matrix convex and also semi-algebraic, the challenge is to prove that there 
is actually a finite collection of (finite) LMIs which define C. The techniques used to meet this 
challenge have little relation to previous work on convex non-commutative basic semi-algebraic 
sets. In particular, they do not involve non-commutative calculus and positivity. See [HM] for 
the details. 



12 



HELTON, KLEP, AND MCCULLOUGH 



3.1. Non-commutative Basic Open Semi- Algebraic Sets. Suppose p G R(x) is sym- 
metric. In particular, p{0) is a 5 x 6 symmetric matrix. Assume that p{0) >- 0. For each 
positive integer n, let 

3p{n) = {X e (§M"^")9: p{X) >- 0}, 

and define 3p to be the sequence (graded set) {3p{n))^^i. Let Vp{n) denote the connected 
component of of and Vp the sequence (graded set) (^p(n))^^. We call Vp the 

positivity set of p. In analogy with classical real algebraic geometry we call sets of the form 
Dp non- commutative basic open semi-algebraic sets. (Note that it is not necessary to 
explicitly consider intersections of non-commutative basic open semi-algebraic sets since the 
intersection Vp n Vg equals Vp^g.) 

Remark 3.1. By a simple affine linear change of variable the point can be replaced by A G M^. 
Replacing by a fixed A G (SM"^")^ would require an extension of the theory. ■ 

3.2. Convex Semi- Algebraic Sets. To say that T>p is convex means that each 'Dp{n) is 
convex (in the usual sense) and in this case we say T)p is a convex non-commutative basic 
open semi-algebraic set. In addition, we generally assume that T)p is bounded; i.e., there 
is a constant K such for each n and each X G 'Dp(n), we have ||X|| = ^ H-'^jll < K. Thus the 
following list of conditions summarizes our usual assumptions on p. 

Assumption 3.2. Fix p a 5 x 6 symmetric matrix of polynomials in g non-commuting variables 
of degree d. Our standard assumptions are: 

(1) p{0) is positive definite; 

(2) Vp is bounded; and 

(3) Vp is convex. 



3.3. The Result. Our main theorem of this section is 

Theorem 3.3 ([HM]). Every convex non- commutative bounded basic open semi- algebraic set 
(as in Assumption 3.2) has an LMI representation. 

The proof of Theorem 3.3 yields estimates on the size of the representing LMI. 

Theorem 3.4. Suppose p satisfies the conditions of Assumption 3.2. Thus p is a symmetric 
6 X 6 -matrix polynomial of degree d in g variables. Let v = 6 'Yl'j=o 9^ ■ 

(1) There is a ^ 

< -±+21 and a monic linear pencil L G SIR''^'^(x) such that Vp = V^. 

(2) In the case that p{0) = Is, the estimate on the size of the matrices in L reduces to 



[-1 ■ 

where v = 6 X]j=o g-' ■ 

As usual, 1"^] stands for the smallest integer > ^. Of course 



— when d is even and 
2 



'^—^ — when d is odd. 
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The results above hold even if sets more general than Vp are used. Suppose p(0) is 
invertible and define Ip to be the component of {X : p{X) is invertible} containing 0. Then if 
Ip is bounded and convex, the theorems above still hold for Ip; it has an LMI representation. 

An unexpected consequence of Theorem 3.3 is that projections of non-commutative semi- 
algebraic sets may not be semi-algebraic. For details and proofs see [HM]. 

3.4. Motivation. One of the main advances in systems engineering in the 1990's was the con- 
version of a set of problems to LMIs, since LMIs, up to modest size, can be solved numerically 
by semidefinite programs [SIG98]. A large class of linear systems problems are described in 
terms of a signal- flow diagram S plus constraints (such as energy dissipation). Routine 
methods convert such problems into a non-commutative polynomial inequalities of the form 
p{X) ^ or p{X) >- 0. 

Instantiating specific systems of linear differential equations for the "boxes" in the system 
flow diagram amounts to substituting their coefficient matrices for variables in the polynomial 
p. Any property asserted to be true must hold when matrices of any size are substituted into 
p. Such problems are referred to as dimension free. We emphasize, the polynomial p itself is 
determined by the signal- flow diagram S. 

Engineers vigorously seek convexity, since optima are global and convexity lends itself to 
numerics. Indeed, there are over a thousand papers trying to convert linear systems problems 
to convex ones and the only known technique is the rather blunt trial and error instrument 
of trying to guess an LMI. Since having an LMI is seemingly more restrictive than convexity, 
there has been the hope, indeed expectation, that some practical class of convex situations has 
been missed. The problem solved here (though not operating at full engineering generality, see 
[HHLM08]) is a paradigm for the type of algebra occurring in systems problems governed by 
signal-flow diagrams; such physical problems directly present non-commutative semi-algebraic 
sets. Theorem 3.3 gives compelling evidence that all such convex situations are associated to 
some LMI. Thus we think the implications of our results here are negative for linear systems 
engineering; for dimension free problems there is no convexity beyond LMIs. 

A basic question regarding the range of applicability of SDP is: which sets have an LMI 
representation? Theorem 3.3 settles, to a reasonable extent, the case where the variables are 
non-commutative (effectively dimension free matrices). 



4. Convex Polynomials 

We turn now from non-commutative convex sets to non-commutative convex polynomials. 
If p is concave {—p is convex) and monic, then the set S = {X : p{X) ^ 0} is a convex non- 
commutative basic open . If it is also bounded, then, by the results of the previous section, it 
has an LMI representation. However, much more is true and the analysis turns on a nc version 
of the Hessian and connects with nc semi-algebraic geometry. 
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A symmetric polynomial p is matrix convex, or simply convex for short, if for each 
positive integer n, each pair of tuples X e (SM"^")^ and Y € (SM"^")^', and each < t < 1, 



(4.1) 



p{tx + (1 - t)Y) ^ tp{x) + (1 - i)p(y). 



Even in one-variable, convexity in the non-commutative setting differs from convexity in the 
commuting case because here Y need not commute with X. For example, to see that the 
polynomial p = is not matrix convex, let 



and compute 



X 



-x^ + -y4 

2 2 



4 2 




2 




and Y = 


2 2 








2 2 



164 120 
120 84 



which is not positive semidefinite. On the other hand, to verify that is a matrix convex 
polynomial, observe that 

tX"^ + (1 - t)Y'^ - (tX + (1 - t)Yf = t{l - t){X - Yf >z 0. 

It is possible to automate checking for convexity, rather than depending upon lucky choices 
of X and Y as was done above. The theory described in [CHSY03], leads to and validates 
a symbolic algorithm for determining regions of convexity of non-commutative polynomials 
and even of non-commutative rational functions (for non-commutative rationals see [KVV09, 
HMV06]) which is implemented in NC Algebra. 

Let us illustrate it on the example p{x) = x^. The NCAlgebra command is 
NCConvexityRegion[Function F, {Variables x}]. 

In[l] := SetNonCommutative [x] ; 

In [2] := NCConvexityRegionE x**x**x**x, {x> ] 

0ut[2]:= { {2, 0, 0>, {0, 2>, {0, -2} > 

which we interpret as saying that p{x) = x^ is convex on the set of matrices X for which the 
the 3x3 block matrix valued non-commutative function 



(4.2) 




2 
-2 



is positive semidefinite. Since p{X) is constant and never positive semidefinite, we conclude 
that p is nowhere convex. 

This example is a simple special case of the following theorem. 



Theorem 4.1 ([HM03]). Every convex symmetric polynomial in the free algebra R{x) has 
degree two or less. 
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4.1. The Proof of Theorem 4.1 and its Ingredients. Just as in the commutative case, 
convexity of a symmetric p € M(x) is equivalent to positivity of its Hessian (7(x)[/i] which is a 
polynomial in the 2g variables ) and h = (hi, . . . ,hg). Unlike the commutative 

case, a positive non-commutative polynomial is a sum of squares. Thus, if p is convex, then 
its Hessian g'(x)[/i] is a sum of squares. Combinatorial considerations say that a Hessian which 
is also a sum of squares must come from a polynomial of degree two. In the remainder of this 
section we flesh out this argument, introducing the needed definitions, techniques, and results. 

4.1.1. Non-commutative Derivatives. For practical purposes, the A;*'*-directional derivative 
of a nc polynomial p is given by 

P^'\x)[h] = ^p{x + th)[^^. 

Note that p^^\x)[h] is homogeneous of degree k in h and moreover, if p is symmetric so is 
/(x)[/i]. For X,H e (§R"^")9 observe that 

^ ^ ^ t^o t 

Example 4.2. The one variable p{x) = x^ has first derivative 

p'{x)[h] = hxxx + xhxx + xxhx + xxxh. 

Note each term is linear in h and h replaces each occurrence of x once and only once. The 
Hessian, or second derivative, of p is 

p"{x)[h] = 2hhxx + 2hxhx + 2hxxh + 2xhhx + 2xhxh + 2xxhh. 

Note each term is degree two in h and h replaces each pair of x's exactly once. □ 

Theorem 4.3 ([HP07]). Every symmetric polynomial p G M(x) whose k^^ derivative is a 
matrix positive polynomial has degree k or less. 

Proof. See [HP07] for the full proof or [HMOS] for case of = 2. The very intuitive proof based 
upon a little non-commutative semi-algebraic geometry is sketched in the next subsection. ■ 

4.1.2. A Little Non-Commutative Semi-Algebraic Geometry. The proof of Theorem 4.1 em- 
ploys the most fundamental of all non-commutative Positivstellensatze. 

A symmetric non-commutative polynomial p is matrix positive or simply positive pro- 
vided p{Xi, . . . , Xg) is positive semidefinite for every X € (SM"^")^ (and every n). An example 
of a matrix positive polynomial is a Sum of Squares of polynomials, meaning an expression 
of the form 

c 

P{x) = ^hj{x)*hj{x). 
i=i 

Substituting X € (SM"^")f gives p{X) = Xl^^i hj{X)*hj{X) t 0. Thus p is positive. Remark- 
ably these are the only positive non-commutative polynomials. 

Theorem 4.4 ([Hel02]). Every matrix positive polynomial is a sum of squares. 
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This theorem is just a sample of the structure of non-commutative semi- algebraic geometry, 
the topic of Section 5. 

Suppose p G M.{x) is (symmetric and) convex and Z,H ^ (SM"^")^ and f € M are given. 
In the definition of convex, choosing X = Z + tH and Y = Z — tH, it follows that 

0^p{Z + tH)+ p{Z - tH) - 2p{Z) , 

and therefore 

-< lim P(^+*g)+P(^-'g)-2pm ^ 

Thus the Hessian of p is matrix positive and since, in the non-commutative setting, positive 
polynomials are sums of squares we obtain the following theorem. 

Proposition 4.5. If p is matrix convex, then its Hessian p" {x)[h] is a sum of squares. 

4.1.3. Proof of Theorem 4.1 by example. Here we illustrate the proof of Theorem 4.1 based 
upon Proposition 4.5 by showing that p{x) = x'^ is not matrix convex. Indeed, lip{x) is matrix 
convex, then p"{x)[h\ is matrix positive and therefore, by Proposition 4.5, there exists a £ and 
polynomials fi{x,h), . . . , fi{x, h) such that 

—p" {x)[}i\ = hhxx + hxhx + hxxh + xhhx + xhxh + xxhh 

= fi{x, hrf^ix, h) + --- + fe{x, hrfeix, h). 

One can show that each fj{x,h) is linear in h. On the other hand, some term f*fi contains 
hhxx and thus fi contains hx"^. Let m denote the largest £ such that some fj contains the term 
hx^. Then m > 1 and for such j, the product f*fj contains the term hx'^^h which cannot be 
cancelled out, a contradiction. ■ 

The proof of the more general, order k derivative, is similar, see [HP07]. 

4.2. Non-commutative Rational and Analytic Functions. A class of functions bigger 
than nc polynomials is given by nc analytic functions, see e.g. Voiculescu [Voi04, VoilO] or 
the forthcoming paper of Kaliuzhnyi-Verbovetskyi and Vinnikov for an introduction. The 
rigidity of nc bianalytic maps is investigated by Popescu [PoplO]; see also [HKMS09, HKMlla, 
HKMllb]. For other properties of nc analytic functions, a very interesting body of work, e.g. by 
Popescu [Pop09] can be used as a gateway. 

The articles [BGM06, KVV09, HMV06] deal with non-commutative rational functions. 
For instance, [HMV06] shows that if a non-commutative rational function is convex in an open 
set, then it is the Schur Complement of some monic linear pencil. 



5. Algebraic Certificates of Positivity 

In this section we give a brief overview of various free *-algebra analogs to the classical 
Positivstellensatze, i.e., theorems characterizing polynomial inequalities in a purely algebraic 
way. Here it is of benefit to consider free non-symmetric variables. That is, let x = (xi, . . . , Xg) 
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be non-commuting variables and x* = another set of non-commuting variables. 

Then M(2;, x*) is the free *-algebra of polynomials in the non-commuting indeterminates x, x* . 

There is a natural involution * on ]R(x,x*) induced by Xi i— )• x| and x*j i— ?• Xj. As before, 
p € M(x, X*) is symmetric lip = p*. An element of the form p*p is a square, and denotes the 
convex cone of all sums of squares. Given a matrix polynomial p = PwW G M(x, x*)''^'' and 
X £ we define the evaluation p{X,X*) by analogy with evaluation in the symmetric 

variable case. 

5.1. Positivstellensatze. This subsection gives an indication of various free *-algebra analogs 
to the classical theorems characterizing polynomial inequalities in a purely algebraic way. We 
will start by sketching a proof of the following refinement of Theorem 4.4. 

Theorem 5.1 ([Hel02]). Letp G M(x,x*)rf be a non- commutative polynomial. Ifp{M,M*) ^ 
for all g-tuples of linear operators M acting on a Hilhert space of dimension at most N{k) : = 
dimM(x,x*)fc with 2k>d + 2, then p € S^. 

Proof. Note that a polynomial p satisfying the hypothesis automatically satisfies p = p* . The 
only necessary technical result we need is the closedness of the cone S| in the Euclidean 
topology of the finite dimensional space M(x,x*)fe. This is done as in the commutative case, 
using Caratheodory's convex hull theorem, more exactly, every polynomial of S^, is a convex 
combination of at most dim]R(x,x*)fc -|- 1 squares (of polynomials). On the other hand the 
positive functionals on S|, separate the points of M(x,x*)fc. See for details [HMP04]. 

Assume that p ^ T? and let k > {d + 2)/2, so that p € ]R(x, x*)2fc_2- Once we know 
that is a closed cone, we can invoke Minkowski separation theorem and find a symmetric 
functional L E ]R(x,x*)2^, providing the strict separation: 

L(p)<o<L(/), /esL. 

Applying the Gelfand-Naimark-Segal construction to L yields a tuple M of operators acting 
on a Hilbert space H of dimension N{k) and a vector & H, such that 

0<{p{M,M*)^,O = Hp)<0, 
a contradiction. ■ 

When compared to the commutative framework, this theorem is stronger in the sense 
that it does not assume a strict positivity of p on a well chosen "spectrum". Variants with 
supports (for instance for spherical tuples M : M*Mi + ... + M*Mg ^ /) of the above result 
are discussed in [HMP04]. 

To draw a very general conclusion from the above computations: when dealing with 
positivity in a free *-algebra, the standard point evaluations (or more precisely prime or real 
spectrum evaluations) of the commutative case are replaced by matrix evaluations of the free 
variables. The positivity can be tailored to "evaluations in a supporting set". The results 
pertaining to the resulting algebraic decompositions are called Positivstellensatze, see [PDOl] 
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for details in the commutative setting. We state below an illustrative and generic result, from 
[HM04], for sums of squares decompositions in a free *-algebra. 

Theorem 5.2 ([HM04]). Let p = p* £ R{x, x*) and let q = {qi, qk} C M(x, x*) be a set of 
symmetric polynomials, so that 

QM{q) = coirqj; f G R{x,x*), 0<i<k}, qo = l, 

contains 1 — x^xi — ... — x*Xg . If for all tuples of linear bounded Hilbert space operators 
X = {Xi, Xg), we have 

(5.1) qi{X,X*)hO, l<i<k p{X,X*)^0, 
then p € QM(g'). 

Henceforth, call QM{q) the quadratic module generated by the set of polynomials q. 

We omit the proof of Theorem 5.2, as it is very similar to the previous proof. The only 
difference is in the separation theorem applied. For details, see [HM04]. 

Some interpretation is needed in degenerate cases, such as those where no bounded oper- 
ators satisfy the relations qi{X,X*) >z 0. Suppose for example, if cp denotes the defining rela- 
tions for the Weyl algebra and the qi include —(j)*4>. In this case, we would say p{X,X*) >- 0, 
since there are no X satisfying q{X,X*), and voila p G QM(g') as the theorem says. A non- 
archimedean Positivstellensatz for the Weyl algebra, which treats unbounded representations 
and eigenvalues of polynomial partial differential operators, is given in [Sch05]. 

A paradigm practical question with matrix inequalities is: 

Given a non- commutative symmetric polynomial p{a, x) and a n x n matrix tuple A, find 
X ^ if possible which makes p{A,X) >z 0. 

As a refinement of this problem, let q{a, x) be a given nc symmetric polynomial. For a 
given A, find X if possible, such that both q{A, X) and p{A, X) are positive semidefinite. The 
infeasibility of this latter problem is equivalent to the statement, if q{A, X) ^ 0, then p{A, X) ^ 
0. There is keen interest in numerical solutions of such problems. The next theorem informs 
us that the main issue is the matrix coefficients A, as it gives a "certificate of infeasibility" for 
the problem in the absence of A. 

Theorem 5.3 (The Nirgendsnegativsemidefinitheitsstellensatz [KS07]). Let p = p* G M.{x,x*) 
and let q = {qi, ...,qk} C M{x,x*) be a set of symmetric polynomials, so that QM(g) contains 
l — x'lxi — ... — x*Xg . If for all tuples of linear bounded Hilbert space operators X = {Xi, ...,Xg), 
we have 

(5.2) qi{X,X*)hO, l<i<k p(X,X*)^0, 

then there exists an integer r and hi, . . . ,hr € M(x, x*) with J2l=i KP^i G 1 + QM(g). 
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Proof. By (5.2), 

{X I qi{X,X*) hO, l<i<k, -p{X,X*) ^ 0} = 0. 
Hence -1 € QM(g, -p) by Theorem 5.2. ■ 

5.2. Quotient Algebras. The results from Section 5.1 allow a variety of specializations to 
quotient algebras. In this subsection we consider a two sided ideal I of M{x,x*) which need 
not be invariant under *. Then one can replace the quadratic module QM in the statement of 
a Positivstellensatz with QM(g) + X, and apply similar arguments as above. For instance, the 
next simple observation can be deduced. 

Corollary 5.4. Assume, in the hypotheses of Theorem 5.2, that the relations (5.1) include 
some relations of the form r{X,X*) = 0, even with r not symmetric, then 

(5.3) peqM{q)+Ir 

where Ir denotes the two sided ideal generated by r. 

Proof. This follows immediately from p G QM(g, —r*r) which is a consequence of Theorem 
5.2 and the fact 

qM{q, -r*r) C QM(g)+X,. ■ 

For instance, we can look at the situation where r is the commutator [xj, Xj] as insisting on 
positivity of q{X) only on commuting tuples of operators, in which case the ideal I generated 
by [ Xj,x*], [xi,Xj] is added to QM((7). The classical commuting case is captured by the 
corollary applied to the "commutator ideal": [xi,xj], [xi,x*] hj = which 

requires testing only on commuting tuples of operators drawn from a commuting C*-algebra. 
The classical Spectral Theorem, then converts this to testing only on C^, cf. [HP07]. 

The situation where one tests for constrained positivity in the absence of an archimedean 
property is thoroughly analyzed in [Sch09]. 

5.3. A Nullstellensatz. With similar techniques (well chosen, separating, *-representations 
of the free algebra) and a rather different "dilation type" of argument, one can prove a series 
of Nullstellensatze. 

We state for information one of them. For an early version see [HMP05]. 

Theorem 5.5. Let qi{x), ...,qm{x) € M(x) be polynomials not depending on the x* variables 
and let p{x,x*) G M(a;,x*). Assume that for every g tuple X of linear operators acting on a 
finite dimensional Hilbert space H , and every vector v £ H, we have: 

{qj{X)v = 0, 1 < i < m) ^ {p{X,X*)v = 0). 

Then p belongs to the left ideal M.{x,x*)qi + ... + M(x,x*)qm- 

Again, this proposition is stronger than its commutative counterpart. For instance there 
is no need of taking higher powers of p, or of adding a sum of squares to p. Note that here M{x) 
has a different meaning than earlier, since, unlike previously, the variables are nonsymmetric. 
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We refer the reader to [HMP07] for the proof of Theorem 5.5. An earher, transpose-free 
Nullstellensatz due to Bergman was given in [HM04] . 

Here is a theorem which could be regarded as a very different type of non-commutative 
Nullstellensatz. 

Theorem 5.6 ([KS08a, Theorem 2.1]). Let p = p* ]R(x,x*)rf be a non-commutative polyno- 
mial satisfying trp{M, M*) = for all g -tuples of linear operators M acting on a Hilbert space 
of dimension at most d. Then p is a sum of commutators of non- commutative polynomials. 

We end this subsection with an example which goes against any intuition we would carry 
from the commutative case, see [HM04]. 

Example 5.7. Let q = {x* x -\- xx*)"^ and p = x-\-x* where x is a single variable. Then, for every 
matrix X and vector v (belonging to the space where X acts), q{X)v = implies p{X)v = 0; 
however, there does not exist a positive integer m and r, E ]R(x,x*), so that 

(5.4) p^™- + ^ r*rj = qr + r*q. 

Moreover, we can modify the example to add the condition q{X) is positive semidefinite implies 
p{X) is positive semidefinite and still not obtain this representation. □ 

5.4. Tracial Positivstellensatz. Another type of non-commutative positivity is given by 
the trace. A polynomial p € M(x,x*) is called trace-positive if ixp{X,X*) > for all X G 
(R"-^"')^. The main motivation for studying these comes from two outstanding open problems: 
Connes' embedding conjecture [Con76] from operator algebras [KS08a] and the Bessis-Moussa- 
Villani (BMV) conjecture [BMV75] from quantum statistical mechanics [KS08b]. 

Clearly, a sum of a matrix positive (i.e., sum of hermitian squares by Theorem 5.1) and a 
trace-zero (i.e., sum of commutators by Theorem 5.6) polynomial is trace-positive. However, 
unlike in the matrix positive case, not every trace-positive polynomial is of this form [KSOBa, 
KSOSb]. 

Example 5.8. Let x denote a single non-symmetric variable and 

Mo := - 2,{xx*f - 4x^x* - 2x^{x*f + 2x'^x*x{x*f + 2x'^{x*fxx* + 2(xx*)^ 
Then the non-commutative Motzkin polynomial in non-symmetric variables is 

M ■.= 1 + Mq + Mq* e M(x, X*). 
It is trace-positive but is not a sum of hermitian squares and commutators. □ 

Life is somewhat easier in the constrained, bounded case. For instance, in the language 
of operator algebras we have: 

Theorem 5.9 ([KS08a]). For f = f* £ R{x,x*) the following are equivalent: 

(i) tr(/(a,a*)) > for all finite von Neumann algebras A and all tuples of contractions 
a e A3; 
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(ii) for every e G M>o, f + £ is a sum of commutators and of an element from 
QM(1 - xlxi, . . . , 1 - x*gXg). 

The big open question [Con76, KS08a] is whether (i) or (ii) is equivalent to 

(iii) tr {f{X, X*)) > for ah n € N and all tuples of contractions X € (IR"^")^'. 

An attempt at better understanding trace-positivity is made in [BK], where the duality 
between trace-positive polynomials and the tracial moment problem is exploited. The tracial 
moment problem is the following question: For which sequences (yw) indexed by words w in 
x,x*, does there exist n E N, and a positive Borel measure fi on (M"'^"')^ satisfying 



Such a sequence is a tracial moment sequence. If one is interested only in finite sequences {yw), 
then this is the truncated tracial moment problem. 

To a sequence y = (yw) one associated the (infinite) Hankel matrix M{y), indexed by 
words, by M{y)u,v = yu*v One of the results in [BK] shows that if M(y) is positive semidefinite 
and of finite rank, then y is a tracial moment sequence. In the truncated case a condition called 
"flatness" governs the existence of a representing measure, much like in the classical case. For 
details and proofs see [BK]. 

For the free non-commutative moment problem we refer the reader to [McCOl]. 



This section briefly surveys existing software dealing with non-commutative convexity 
(Section 6.1) and positivity (Section 6.2). 

6.1. NC Algebra under Mathematica. Here is a list of software running under NC Algebra 
[HdOSMll] (which runs under Mathematica) that implements and experiments on symbolic 
algorithms pertaining to non-commutative Convexity and LMIs. 

NC Algebra is available from http://www.math.ucsd.edu/~ncalg 

• Convexity Checker. Camino, Helton, Skelton, Ye [CHSY03] have an (algebraic) 
algorithm for determining the region on which a rational expression is convex. 

• Classical Production of LMIs. There are two Mathematica NCAlgebra notebooks 
by de Oliveira and Helton. The first is based on algorithms for implementing the 1997 
approach of Skelton, Iwasaki and Grigonidas [SIG98] associating LMIs to more than 
a dozen control problems. The second (requires C++ and NCGB) produces LMIs by 
symbolically implementing the 1997 change of variables method of Scherer et al. 

• Schur Complement Representations of a non-commutative rational. This 
computes a linear pencil whose Schur complement is the given nc rational function p 
using Shoppie - Slinglend thesis algorithm. It is not known if p convex near always 
leads to a monic pencil via this algorithm, but we never saw a counter example. 
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• Determinantal Representations. Finds Determinantal Representations of a given 
polynomial p. Shoppie - Slinglend implement Slinglend's thesis algorithm plus the 
[HMV06] algorithm. Requires NCAlgebra. 

See http://www.math.ucsd.edu/~ncalg/surveydemo for occurences of available demos. 

6.2. NCSOStools under Matlab. NCSOStools [CKPll] which runs under Matlab, imple- 
ments and experiments on numeric algorithms pertaining to non-commutative positivity and 
sums of squares. Here is a sample of features available. 

• Non-commuting variables. Basic symbolic computation with nc variables for Mat- 
lab has been implemented. 

• Matrix-positivity. An nc polynomial p is matrix positive if and only if it is a sum 
of squares. This can be easily tested using a variant of the classical Gram matrix 
method. Indeed, p G W{x)2d is a sum of squares if and only if p = {x)*^G{x)d for 
a positive semidefinite G. (Here, (x)^ denotes a (column) vector of all words in x of 
degree < d.) This can be easily formulated as a feasibility semidefinite program (SDP). 

• Eigenvalue optimization. Again, using SDP we can compute the smallest eigenvalue 
/* a symmetric / € can attain. That is, 

/* = inf \^{f{A)v,v) : A a g-tup\e of symmetric matrices, v a unit vector |. 

Hence /* is the greatest lower bound on the eigenvalues f{A) can attain for (^-tuples 
of symmetric matrices A, i.e., (/ — f*){A) ^ for all n-tuples of symmetric matrices 
A, and /* is the largest real number with this property. Given that a polynomial is 
matrix positive if and only if it is a sum of squares we can compute /* efficiently with 
SDP: 

/* = sup A 
s.t. /-A G S2. 

• Minimizer extraction. Unlike in the commutative case, if /* is attained, then mini- 
mizers {A, v) can always be computed. That is, A is a (7-tuple of symmetric matrices 
and t; is a unit eigenvector for f{A) satisfying 

r = {f{A)v,v). 

Of course, in general / will not be bounded from below. Another problem is that 
even if / is bounded, the infimum /* need not be attained. The core ingredient of 
this minimizer extraction is the nc moment problem governed by a condition calles 
flatness" , together with the GNS construction. 

• Commutators and Cyclic equivalence. Two polynomials are cyclically equivalent 
if their difference is a sum of commutators. This is easy to check. 

• Trace-positivity. The sufhcient condition for trace-positivity (i.e., sum of squares up 
to cyclic equivalence) is tested for using a variant of the Gram matrix method applied 
to matrix positivity. 

NCSOStools is extensively documented and available at http://ncsostools.fis.unm.si 
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